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Background Information 




Problem Statement 

• How do you V&V a Piloted Adaptive system? 

• Constraints: 

- Piloted aircraft (Modified F-15) 

• Pilot limited any transients to +/-. 5 lateral gees & + 1-2 longitudinal. 

- Flight Control Computers (quad system) (Level A) 

- The adaptive algorithms are processed on a single string 
system called ARTSII (Level B) 

- Any maneuver can not exceed 80% structural load limit. 
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F-15 IFCS Project Goals 




* Demonstrate Control Approaches that can 
Efficiently Optimize Aircraft Performance in both 
Normal and Failure Conditions [A] & [B] failures. 

* Advance Neural Network-Based Flight Control 
Technology for New Aerospace Systems Designs 
with a Pilot in the Loop 
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Gen II Objectives 




• Implement and Fly a Direct Adaptive Neural Network Based 
Flight Controller 

• Demonstrate the Ability of the System to Adapt to 
Simulated System Failures 

- Suppress Transients Associated with Failure 

- Re-Establish Sufficient Control and Handling of Vehicle for 
Safe Recovery 

• Provide Flight Experience for Development of Verification 
and Validation Processes for Flight Critical Neural Network 
Software 
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Motivation 


IFCS has potential to 
reduce the amount of 
skill and luck required 
for survival 


These are survivable accidents 
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ASA NF-15B Tail Number 83 


xtensively modified F-15 airframe 



Canards 



vectoring 


computational capability 


nozzles 


(Neural Network algorithm) 


• Quadraplex 
digital flight control 

system 

• No mechanical or 
analog backup 

• Research control 
law processor 
(Enhanced Mode) 
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V & V Issues 

• System Overview Architecture 

Quad digital flight control computers (Level A) 

• Airborne Research Test System II (ARTSII) (single string 
Level B) 

• Project tried to prove stability issues using Lyapunov 
methods for V&V but was not conclusive. 

• Assumptions: 

- Single string signals may go hard over any time. 

- Note: If you had a dual redundant ARTSII the V&V task 
would be different then this projects V&V. 
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Limited Authority System 

Single Channel 400 Mhz 







Adaptation algorithm 
implemented in separate 
processor 

- Class B software 

- Autocoded directly from Simulink 
block diagram 

- Many configurable settings 

• Learning rates 

• Weight limits 

• Thresholds, etc. 

Control laws programmed in 
Class A, quad-redundant system 

Protection provided by floating 
limiter on adaptation signals 
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ARTS II 



• Provides Added Capacity (Throughput and Memory) to 
Run the IFCS Advanced Algorithms 

• Airborne Research Test System II (ARTS II) 

- VME Based System 

- 3 Single Board Computer (SBC) Processor Cards 

• 1553 Interface 

- PowerPC 750 

• 400MHz Operating System 

• 66Mhz Local Bus 

- 1 MB L2/Cache 

- 128 MB of SDRAM 
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Gen II Architecture 
(non Adaptive) 



pilot 
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Flight Experiment 




* Assess Handling Qualities of Gen II Controller 
without Adaptation 


• Activate Adaptation and Assess Changes in 
Handling Qualities 

* Introduce Simulated Failures 


- Control Surface Locked (“B Matrix Failure”) 

- Angle of Attack to Canard Feedback Gain Change (“A 
Matrix Failure”) 

* Report on “Real World” Experience with a Neural 
Network Based Flight Control System 
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Direct Adaptive Neural Network 

Neural Network Design and Implementation for 

the F-15 837 
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F-15 Intelligent Flight Control Systems 


•Motivation / Problem Statement {The Big Picture} 

• Land a damaged airplane or, return to a safe ejection site. 

•General Goals & Objectives 

• Flight evaluation of neural net software. 

• Increased survivability in the presence of failures or aircraft damage. 

• Increase your boundary of a fly able airplane. 

• Increase your chances to see another day. 

• Increase your chances to continue the mission. 



17 



Background : Historical Note 



• Neural Networks are a subset of Adaptive Control. 

• Adaptive Control Research Started in the early 1950’s. 

- Auto-Pilot work (non-Neural Network). 

• Research Diminished due to the crash of X-15. 

- Reference: Eugene Lavretsky, “Adaptive Control: Introduction, Overview, 
and Applications.” 
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General Neural Network 
Problem Statements Plus Others 




• Why Use a Neural Network? 

• How much do Neural Networks help a controller? 

• Why Use Dynamic Inverse Control? 

• How much do Neural Networks cost w.r.t. compute power? 

• How can we certify a Neural Network? 

• Some of these questions are NOT answered in this presentation 
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Why Neural Networks? 



Neural Networks are Universal Approximators 
Minimizes a H 2 norm 


They permit a nonlinear parameterization of uncertainty 





-a'V T x 



y = /( x) = W0(FX ) + 8(X) 

e(jc)| <£* V xeQ 
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Neural networks simulate the activity of biological neurons within 
the human body. Neural networks are implemented in an attempt to 
re-create the learning processes of the brain by recognizing patterns. 
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Single Neuron 





bias term (bj) 



Combination function, a: = (x) w jk *x k + 

summation product 
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Multiple neurons 



For 1 neuron with 3 inputs: 




aj = W 0 1 + 

W 7 Xj + 

W 2X 2 + 

W JX 3 + 
W 72 X 1 X 2 X + 


w 13 1 X 3 X 2 + 
X 3 + 

W 123 X 1 X 2 X 3 


[?) means 
product 
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Activation Function 
for fully connected 
neuron 



• Activation function for one neuron is written mathematically in a 
general form as: 
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Higher order terms 

Higher order terms increase the non-linear descriptive capability 
of the individual neurons within a neural network 
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Fully connected 
Higher Order Neural Network 

(HONN) 






Failures 
Investigated 

2 groups of failures are “common” among aircraft mishaps/crashes. 

• Aerodynamic Failures (A Matrix problems / lost aero surfaces, 
bent wings) 

• Canard Failure (0.8 to -1.75 multiplier) 

• Control Failures (B Matrix problems / jammed control surfaces) 
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Overview of Safety Monitors 
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Overview of new Safety 

Monitors 




• Neural Net Limiter 

- Designed to prevent high rate of change of NN 
commands and hard range limits 

- Failure sets Sigma Pi disengage 

• Loads Monitor 

- Model of 40 loads locations on aircraft 
structure 

- If any design limit loads (DLL) are exceeded, 
then disengage Sigma Pi 
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NN Limiter 
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Floating Limiter 




• Requirements 

• Design 

• Simulation validation testing 

• Summary 
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Specific Requirements 




• Acceptance criteria 

- + 2g vertical transient limit 

- + 0.5g lateral transient limit 

- Do not exceed specified load criteria 

• Induce “worst case” D sigma pi error 

- Stay within above limits 
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Design Approach 

• Run safety monitors in FCS at 80hz 

• All inputs to safety monitors are 
redundant (except beta, sigma pi) 

• Tripped monitors will cause a downmode 
from sigma pi to conventional mode with a 
1 sec fader 

• Causes for disengagement are 
instrumented on TM bus 

• Safety monitor parameters are changeable 
from config files or recompile 
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Safety Monitor Constants set 
from Config File Method 

• Purpose 

- Change floating limiter or loads monitor constants without 
recompiling the SCE-3 code 

* Method 

- Load config files and checksum word in ARTS using PTC and 
transmit to FC via 1553 bus (multiplexed) 

- FC will read data into memory and output data on FTDR bus 
upon command sequence from cockpit (ground operation 
only) 

- FC will CCDL the checksum word to all 4 channels 

- The FC will re-compute the config file checksum when the 
ENANCED mode is first engaged. 

- If the checksum does not match the CCDL, the ENHANCED 
mode will be locked out and a CONFIG fail flag will be set 
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Floating Limiter Design 

• Apply a floating limiter window for the 
sigma pi commands (P,Q,R) 

• Maximum rate of change is allowed within 
the window 

• Limit the rate of change while on the 
floating limiter boundary 

• Allow full authority up to the range limiter 

• Provide flags to sigma pi to stop learning 
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NISI Floating Limiter 



Upper range limit (down mode) 



Tunable metrics 

Black - sigma pi cmd Window delta 

Green - floating limiter boundary Drift rate 

Orange - limited command (fl_drift_flag) Persistence limiter 

Red - down mode condition (fl_dmode_flag Range limits 
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Floating Limiter Regions 
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Loads Monitor 
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Canard Root - Shear, Bending, Torsion 
Wing Root - Bending 

Horizontal Tail Root - Shear, Bending, Torsion 
Vertical Tail Root - Shear, Bending 
Aileron and Rudder - Hinge Moment 
Forward Fuselage 400 - Vert, and Lat. Bending - SE 
- Vert, and Lat. Shear 

Aft Fuselage 627 - Vert, and Lat. Bending - SE 
- Lat. Shear and Torsion 
Aft Fuselage 749 - Vert. Shear, Torsion - SE 
Tail Boom - Strength Envelope 


Not Shown : 

Forward Fuselage 425 - Torsion 
Engine Main Mounts - Vertical, Thrust 
Engine Forward and Side Links - Axial 


SE 



20 Load Stations 
45 Loads 

40 Allowables - %DLL 
5 Strength Envelopes 


Positive Forces and Moments Shown 
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Verification 

• Simulink Block Diagrams on NN 

• Define I/O of NN signals 

• Test for out of range for input signals 

• Test for fault detection, identification, reversion logic 

• Test NN with safety monitor to limit loads and G excursions 

• Test loads and floating limiters 

• Document test results 

Validation 

• Perform Avionics System closed loop Interface test 

• Perform closed loop 1553 bus I/O testing, data latency, sample 
rate 

• Perform closed loop testing using input file from and compare 
results 

• Evaluate transients from Adaptive to conventional mode 

• Perform functional test plan & Flight Test. 
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Neural Network Flight Test Video 


[A] matrix failure with adaptation on and off during a 

1 g formation flight 



April, 2009 


©2009 TIIOM IS .1 BIJXCE 
WWW.RIVETIXGPnOTOS.COM 


40 


Conclusions 




* V&V for this project was by Limiting the size of 
the single string inputs from the ARTSII 
computer. 

• We had 14 neural network trip outs due the the 
floating limiter. 
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